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FOREWORD 


The  Program  to  Develop  Efficiency  in  Visual  Functioning  was 
made  possible  through  Grant  No.  G007605448  awarded  the  American 
Printing  House  for  the  Blind  by  the  Bureau  of  Education  for  the 
Handicapped;  U.S.  Office  of  Education;  Department  of  Health,  Educa 
tion,  and  Welfare.  The  new  program  is  based  on  the  earlier  Uti  1  i - 
zation  of  Low  Vision  Kit  (Barraga,  1970)  which  was  disseminated  ~ 
nationally  as  a  cooperative  project  by  the  author,  the  Bureau  of 
Education  of  the  Handicapped,  the  American  Printing  House,  and  a 
national  group  of  consultants. 

The  Utilization  of  Low  Vision  Kit  has  been  well  received  and 
widely  used  since  its  publication  by  the  American  Printing  House. 
However,  research  by  Ozias  (1975)  revealed  the  need  for  extensive 
revision  and  expansion  of  both  its  components;  namely,  the  Visual 
Efficiency  Scale  and  the  Teacher's  Guide.  The  purposes  of  the  pro 
ject  in  which  the  new  program  was  developed  were  to  (a)  revise  and 
expand  the  teaching  materials,  (b)  revise  and  expand  the  Visual 
Efficiency  Scale  into  a  diagnostic  assessment  procedure,  and  (c) 
develop  basic  student  materials. 

The  Program  to  Develop  Efficiency  in  Visual  Functioning  has 
resulted  from  the  cooperative  efforts  of  Natalie  C.  Barraga  and 
her  staff  at  the  University  of  Texas  at  Austin,  who  were  responsi¬ 
ble  for  developing  the  program  materials,  and  the  research  and 
development  staff  at  the  American  Printing  House,  who  were  respon¬ 
sible  for  evaluation  of  the  materials.  Both  were  supported  and 
assisted  by  a  group  of  knowledgeable  consultants. 
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project.  These  teachers  critiqued  the  materials  as  they  used  them 
and,  simultaneously,  provided  student  data.  All  of  this  information 
was  used  in  the  development  of  the  Program  to  Develop  Efficiency  in 
Visual  Functioning.  The  program  represents  a  vastly  revised  and 
expanded  Utilization  of  Low  Vision  Kit. 
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Abstract 


The  purpose  of  the  project  was  to  develop  a  program  that  would 
facilitate  the  efficiency  with  which  legally  blind  persons  use 
their  remaining  vision.  The  content  of  the  program  was  based  upon 
a  review  of  literature  pertaining  to  low  vision,  visual  perception, 
and  visual  development  and  information  received  from  teachers  of 
the  visually  handicapped.  In  its  final  form  the  program  consists 
of  the  following  components: 

Diagnostic  Assessment  Procedure  which  is  a  40-item  instrument  for 
determining  level  of  visual  functioning  and  identifying  appropriate 
lessons  for  use 

Design  for  Instruction  which  includes  150  lessons  sequenced  to 
increase  visual  efficiency 

Source  Book  on  Low  Vision  which  includes  extensive  material  on  low 
vision  and  its  use  as  well  as  materials  lists  for  low  vision,  a 
glossary,  and  a  bibliography. 

Throughout  the  development  of  the  program  a  panel  of  consultants 
reviewed  all  the  materials  of  each  component  before  they  were 
field-evaluated.  The  Diagnostic  Assessment  Procedure  was  evaluated 
by  administering  it  twice  to  112  legally  blind  students  ages  5-20. 
Reliability  coefficients  showed  the  Diagnostic  Assessment  Procedure 
to  have  high  internal  consistency  (KR  -  20  =  .94)  and  to  be  highly 
accurate  (test  -  retest,  r_  =  .96).  In  the  final  phase  of  the  pro¬ 
ject  the  complete  program  was  used  by  11  teachers  of  the  visually 
handicapped  with  22  legally  blind  students.  The  program  was  given 
high  ratings  by  all  teachers.  Without  special  training  or  instruc¬ 
tions  other  than  the  instructions  provided  in  the  program,  these 
teachers  were  able  to  use  the  program  efficiently  with  their  stu¬ 
dents  . 
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In  1964  Barraga's  publication.  Increased  Visual  Behavior  in 
Low  Vision  Children,  attracted  worldwide  attention  in  the  field  of 
the  visually  handicapped.  Barraga's  (1964)  study  demonstrated  that 
the  efficiency  with  which  handicapped  students  use  their  residual 
vision  could  be  increased  with  specific,  systematic  training.  The 
original  study  was  then  replicated  successfully  by  Ashcroft, 
Halliday,  and  Barraga  (1965)  and  later  Holmes  (1967)  demonstrated 
the  efficacy  of  the  concept  with  older  students.  In  1970,  leaders 
in  the  field  of  the  visually  handicapped  recognized  the  acute  need 
for  a  broad  dissemination  effort  to  prepare  teachers  to  provide 
visual  efficiency  training  to  all  children  and  youth  with  useful 
vision,  which  constitutes  about  79%  of  those  classified  as  "legally 
blind."  Subsequently,  the  American  Printing  House  for  the  Blind 
assumed  responsibi 1 i ty  as  a  coordination  center  for  a  program  that 
published  and  distributed  materials  for  a  series  of  institutes  on 
the  utilization  of  low  vision.  These  institutes  were  supported  by 
funds  from  the  Office  of  Education,  U.S.  Department  of  Health,  Edu¬ 
cation  and  Welfare.  The  materials  and  training  procedures  used  in 
these  institutes  were  collectively  named  the  Utilization  of  Low 
Vision  Kit. 

The  primary  components  of  the  Utilization  of  Low  Vision  Kit 
were  the  Visual  Efficiency  Scale  (Barraga,  1970b)  and  the  Teacher's 
Guide  (Barraga,  1970a).  The  Visual  Efficiency  Scale  consisted  of 
48  items  printed  in  black  and  white.  The  items  involve  either 
matching  or  noting  likenesses  and  differences  in  visual  stimuli 
and  range  in  size  from  large  (3/4  inch  [2  cm])  geometric  forms  to 
small  (8  point)  type.  The  visual  skills  necessary  to  respond  to 
the  progressively  more  difficult  items  include  discrimination  of 
solid  and  outline  geometric  and  object  figures  in  decreasing  size; 
discrimination  of  spatial  position  and  pattern  detail  in  abstract 
figures  and  objects;  and  discrimination  of  letter  and  word  symbols 
singly  and  in  groups.  Instructions  for  administration  and  use  of 
the  scale  are  included.  Profile  sheets  enable  the  teacher  to  chart 
levels  of  visual  functioning  and  assist  in  identifying  visual  skills 
already  present  as  well  as  those  needing  to  be  learned.  From  the 
profile,  individualized  plans  for  specific  aspects  of  visual  learn¬ 
ing  can  be  projected. 

The  Teacher's  Guide  is  primarily  a  series  of  suggestions  based 
on  the  rationale  that  visual  development  in  low  vision  students 
progresses  satisfactorily  only  through  a  sequence  of  visual  learn¬ 
ing  experiences  and  that  visual  efficiency  increases  in  relation  to 
expanded  visual  skills  and  the  learning  experiences.  General  objec¬ 
tives  are  outlined  for  (a)  observing  visual  functioning  with  mater¬ 
ials,  (b)  recognizing  visual  potential,  (c)  fostering  positive 
attitudes  about  looking,  and  (d)  encouraging  and  reinforcing  use  of 
vision  in  general  activities.  A  series  of  objectives  for  visual 
development  and  increased  visual  efficiency  is  outlined,  a  sequence 
of  activities  is  suggested  to  promote  the  achievement  of  each  objec¬ 
tive,  and  numerous  appropriate  visual  materials  to  be  used  are 
i denti fi ed. 
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A  study  of  the  reliability  and  validity  of  the  Visual  Effi¬ 
ciency  Scale  with  low  vision  children  (Harley  &  Spollen,  1973) 
revealed  content  validity  and  internal  consistency.  However,  about 
1/3  of  the  items  on  the  scale  did  not  show  discrimination  between 
high  and  low  scorers.  The  suggestion  was  made  that  some  items 
might  be  placed  i nappropriately  according  to  efficiency  ratings 
and  that  some  identified  visual  behaviors  did  not  have  representa¬ 
tive  discriminatory  items. 

Since  the  Uti 1 ization  of  Low  Vision  Kit  was  published  in  1970, 
the  author,  Natalie  Barraga,  has  worked  with  teachers  in  many  resi¬ 
dential  and  public  school  programs  in  every  part  of  the  United 
States  and  in  Canada,  Australia,  England,  and  Brazil.  Almost  with¬ 
out  exception,  suggestions  have  indicated  that  greater  precision  in 
identification  of  specific  visual  behaviors  to  be  achieved  would  be 
valuable.  Many  have  expressed  concern  verbally  about  apparent  gaps 
in  the  sequence  of  activities  suggested  in  the  Teacher's  Guide. 
Teachers  who  work  with  preschool  and/or  retarded  or  multihandicapped 
children  and  youth  have  requested  suggestions  for  observation, 
assessment,  and  programming  at  much  lower  levels  of  visual  function¬ 
ing.  In  addition,  Ozias  (1975)  surveyed  teachers  who  attended  the 
institutes  and  used  the  materials  and  documented  numerous  sugges¬ 
tions  with  respect  to  the  Teacher's  Guide  and  the  Visual  Efficiency 
scale  that  indicated  considerable  revision  of  the  Utilization  of 
Low  Vi  si  on  Ki t  was  needed.  — 

Specification  and  Development  of  the  Components  for  the 

Program  to  Develop  Efficiency  in  Low  Vision  Functioning 

Purpose 


7*ti™hn/iUrp°w^  °f  tt-s  project  was  t0  revise  and  expand  the  Uti  1  i - 
V  I  Low  VTSion  Kit  into  a  more  comprehensive  and  detailed  pro¬ 
gram  that  could  be  utilized  by  vision  teachers  to  evaluate  visual 

pe?sons°nio9,KP  ,OW.vision’  lepally  blind  persons  and  to  train  such 
persons  to  use  their  vision  more  efficiently.  The  components  of  the 

total  program  were  specified  and  included  the  following 

L  Organization  of  Complete  Program  which  provides 

an  introduction  and  overview  of  the  program 

2'  t1nnS°f^C  issessment  Procedure  which  includes  instruc- 

interflced  w?}hTJel"ln9  the  procedure-  40  assessment  items 

ise  with  h  ,essons-  and  all  materials  needed  for 
use  with  the  assessment  items 

3'  tion^essential ‘for4-0"! 1  P,an  which  includes  b«ic  informa- 
and  150  lessnnc  imPlementation  of  the  training  program 
lb0  lessons  sequenced  to  increase  visual  efficiency 

a  gT>ossary^1aSbibl?nnr0khWhiChr)inCludeS  the  materia1s  lists, 
use  of  vision  hut  9raphy,  and  sections  pertinent  to  the 

nonessential  for  implementation  of  the 


program  (e.g.,  major  eye  conditions  and  their  influence  on 
visual  functioning,  magnification  and  low  vision  aids, 
illumination  and  visibility  factors,  etc.). 


Procedure 


In  order  to  develop  each  of  the  components  specified,  over  100 
articles  were  reviewed  in  the  areas  of  visual  perception  (e.g., 
attention,  fixation,  accommodation,  etc.),  normal  visual  develop¬ 
ment,  and  in  other  areas  relating  to  visual  impairment  and  low  vision 
(e.g.,  visual  acuity  and  visual  functioning,  screening  targets, 
magnification  and  optical  aids,  lighting  and  visibility  factors, 
etc.).  From  this,  a  review  of  the  literature  was  written  (Barraga, 
Collins,  &  Hollis,  1977)  in  which  research  findings  were  summarized 
and  related  to  eight  levels  reflecting  the  normal  developmental 
sequence  of  visual  functioning,  which  were  as  follows: 

awareness--visual  sensations  and  intake  of  visual  information 

visual  information  and  beginning  discrimination  of  contours 
and  forms  in  simple  tangible  objects 

discrimination  and  recognition  of  environmental  contours 

visual  information  and  beginning  discrimination  and  recogni¬ 
tion  of  form  and  detail  in  represented  materials 

discrimination,  recognition,  and  perception  of  simple  and  com¬ 
plex  pictures  of  actions,  scenes,  and  situations 

organization  of  visual  perceptions 

discrimination,  recognition,  and  perception  of  abstract  repre- 
sentati  ons 

discrimination,  recognition,  and  perception  of  abstract  num¬ 
bers  and  letter  symbols 

Simultaneously,  an  array  of  specific  visual  functions  (e.g.,  focus, 
accommodation,  fixation,  tracking,  etc.)  were  identified  and 
sequenced  into  optical,  optical  and  perceptual,  and  visual  percep¬ 
tual  categories  to  form  an  outline  for  development  of  both  the 
instructional  program  and  the  assessment  procedure.  The  rationale 
for  the  program  is  based  upon  the  idea  that  the  functions  performed 
by  the  visual  system  interact  with  the  visual/perceptual  developmental 
level  of  the  individual  in  specific  environments  to  produce  a  cer¬ 
tain  degree  of  visual  efficiency  (Barraga  &  Collins,  1979). 

In  addition  to  reviewing  the  literature,  visual  assessment 
instruments  and  teachers'  guides  on  early  childhood  readiness, 
reading  readiness,  and  visual  perceptual  development  were  inspected 
for  content,  format,  and  packaging.  This  information  was  used  in 
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developing  specifications  for  the  materials  that  are  included  in 
the  final  program.  Since  many  of  the  commercial  materials  identi¬ 
fied  were  readily  available  to  teachers,  a  decision  was  made  to 
provide  tangible  materials  only  for  the  Diagnostic  Assessment  Pro¬ 
cedure  and  not  for  the  150  lessons.  Lists  of  commercially  availa¬ 
ble  materials  that  could  be  used  with  the  lessons  were  provided. 

The  materials  lists  included  annotations  and  sources.  However,  all 
graphics  for  the  lessons  were  provided. 

During  the  first  2  years  of  the  project,  drafts  of  the  Theme 
and  Organization  of  the  Complete  Program,  the  Diagnostic  Assessment 
Procedure  and  the  Design  for  Instructional  Plan  were  completed  and 
refined.  Simultaneously,  graphic  and  tangible  materials  required 
for  use  with  the  assessment  procedure  were  acquired  or  developed. 
Subsequently,  all  of  the  materials  were  sent  to  the  project's  con¬ 
sultants  for  independent  expert  review. 

Fourteen  professional  persons  with  special  knowledge  and  inter¬ 
est  in  low  vision  or  test  construction  served  as  consultants  for 
this  project.  A  list  showing  the  persons  serving  in  this  capacity 
is  shown  in  Appendix  A.  During  the  project's  1st  year  the  consult¬ 
ants  met  to  provide  initial  direction  and  input  to  the  development 
of  specifications  for  the  various  components  of  the  program. 

During  the  2nd  year  the  consultants  reviewed  and,  in  some  instances, 
used  the  materials  under  development  and  subsequently  met  with  the 
project  staff  regarding  them.  The  purpose  of  the  meeting  was  to 
come  to  a  group  consensus,  where  possible,  regarding  matters  about 
which  the  review  information  was  ambiguous.  Following  this  meeting, 
the  Diagnostic  Assessment  Procedure  immediately  underwent  modifica¬ 
tion  and  was  readied  for  a  field  evaluation.  Simultaneously,  the 
initial  draft  of  the  Supplemental  Source  Book  was  completed  and 
sent  to  six  of  the  project  consultants  for  review.  The  reviewers' 
comments  and  suggestions  were  tabulated  and  appropriate  revisions 
were  made.  The  Design  for  Instruction  was  developed  during  the 
first  3  years  of  the  project.  A  committee  of  six  persons  reviewed 
each  of  the  150  lessons  and  appropriate  changes  in  both  content  and 
format  were  made  as  a  result  of  the  review. 

Psychometric  Evaluation  of  the 

Diagnostic  Assessment  Procedure 

The  purpose  of  this  phase  of  the  project  was  to  psychometri cal ly 
evaluate  the  Diagnostic  Assessment  Procedure  with  respect  to  its 
internai  consistency,  test-retest  reliability,  content,  and  construct 
validity  (Berla  ,  Rankin,  &  Willis,  1980). 

Method 


Subjects .  The  subjects  for  this 
basis  of  the  following  criteria: 


study  were  selected  on  the 


1.  a  minimum  developmental  level  of  5.5  years  in  age 
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2.  a  minimum  of  1  year  in  a  structured  educational  set¬ 
ting  (kindergarten  and  up) 

3.  legally  blind  (20/200  visual  acuity  or  less  in  the 
better  eye  with  corrective  lens  or  a  visual  field  of 
20  degrees  or  less)  with  a  minimum  of  light  perception 

4.  no  additional  physical  or  mental  handicaps  that  would 
interfere  with  performance  on  the  test 

The  subjects  were  112  legally  blind  pupils  attending  schools 
in  the  United  States  (California,  Georgia,  Kansas,  New  Hampshire, 
New  York,  Oregon,  Texas,  Massachusetts,  Washington)  and  Canada 
(Ontario).  All  subjects  were  volunteers.  There  were  60  males 
(54%)  and  52  females  (46%)  with  89  subjects  from  public  schools 
(79%)  and  23  subjects  from  residential  schools  (21%).  Each  subject 
was  classified  into  one  of  nine  visual  categories  using  the  classi¬ 
fication  system  of  visual  acuity  proposed  by  the  National  Society 
for  the  Prevention  of  Blindness.  For  the  purposes  of  this  study 
another  category  (X)  was  added  to  take  into  account  those  subjects 
who  had  only  restrictions  in  visual  fields  of  less  than  20  degrees 
but  whose  visual  acuities  were  greater  than  20/200.  The  number  and 
percentage  of  subjects  in  each  of  the  visual  categories  is  shown  in 
Table  1 . 


Table  1 

The  Number  and  Proportion  of  Subjects  in  the  Testing  Sample  for 
Each  of  the  Visual  Categories  and  the  Proportion  of  Subjects 
for  the  1976  Quota  Registration  Reported  by  the  American  Print¬ 
ing  House 


Visual  Categories 

Number 

Proporti  on 
of  sample 

Proporti on 
of  1976  quota 
(Willis,  1979) 

I 

20/200  -  18/200 

59 

.54 

.40 

II 

17/200  -  13/200 

5 

.05 

.04 

III 

12/200  -  08/200 

21 

.19 

.12 

IV 

07/200  -  03/200 

4 

.04 

.03 

V 

2.5/200  -  .4/200 

1 

.04 

.01 

VI 

Counts  finger 

7 

.06 

.05 

VII 

Hand  movements 
(includes  "forms" 
object  perception) 

and 

5 

.05 

.05 

VIII 

Light  projection 
and/or  perception 
(includes  shadows) 

6 

.05 

.12 

IX 

Totally  blind 

0 

- 

.18 

X 

Restricted  visual 
field  (20  degrees 
or  less) 

2 

no 

.02 

7 


Note.  The  information  on  two  subjects'  visual  acuity  was 
incomplete  and  consequently  the  data  reported  in  this  table  were 
based  on  110  subjects  instead  of  112.  The  reader  should  note  that 
the  visual  categories  in  this  study  were  slightly  different  from 
those  used  by  Willis  (1979).  If  the  Willis  data  were  recalculated 
to  conform  to  this  category  system,  then  it  would  slightly  increase 
all  of  the  percentages  she  reported.  As  a  consequence,  these  sample 
proportions  would  approximate  her  population  proportions  even  more 
closely  than  they  already  do.  These  proportions  compare  favorably 
to  those  reported  by  Willis  (1979)  using  the  1976  quota  registra¬ 
tion  figures  of  the  legally  blind  students  attending  residential  and 
public  schools  in  the  United  States  as  compiled  by  the  American 
Printing  House  for  the  Blind.  Consequently,  the  results  of  this 
study  can  be  generalized  to  the  legally  blind  population  of  school 
age  students.  The  reader  should  note  that  totally  blind  persons 
were  excluded  from  this  study  and,  consequently,  there  were  no  stu¬ 
dents  classified  in  category  IX. 

The  incidence  of  the  eye  disorders/causes  represented  in  the 
subjects  is  shown  in  Table  2.  The  reader  should  note  that  the  total 
incidence  of  211  exceeds  the  sample  size  of  112  because  most  of  the 
subjects  were  diagnosed  as  having  more  than  a  single  eye  disorder. 
The  large  number  of  eye  disorders  in  the  sample  attests  to  the  great 
heterogeneity  of  visual  disabilities  in  the  population. 

The  subjects'  ages  ranged  from  5-20  years .  The  median  age  was 
10.5  years. 


Table  2 


Diagnoses  and/or  Causes  of  the  Eye  Disorders  Represented 
in  the  Testing  Sample  (Arranged  by  Incidence) 


Name  gi  ven 

1.  Nystagmus 

2.  Cataracts 

3.  Myopia 

4.  Optic  Atrophy 

5.  Albinism 

6.  Aniridia 

7.  Aphakia  (5  indicated  as 

8.  Glaucoma 

9.  Columba 

10.  Estotropia 

11.  Microphthalmos 

12.  Retrol ental  Fibroplasia 

13.  Emblyopia 

14.  Enucleation 

15.  Retinitis  Pigmentosa 

16.  Rubella 

17.  Exotropia 


Inci dence 

38 

22 

13 

13 

11 

9 

surgical)  8 

8 

7 

6 

6 

(RLF)  5 

4 

4 

4 

4 

3 
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Table  2  (cont.) 


Name  given 

Inci dence 

18. 

Myopic  Astigmatism 

3 

19. 

Reti noblastoma 

3 

20. 

Aebiomatopsia 

2 

21. 

Astigmatism  (see  38,  also  18) 

2 

22. 

Corneal  Scarring 

2 

23. 

Hyperopia 

2 

24. 

Hypoplasia 

2 

25. 

Macular  Degeneration 

2 

26. 

Optic  Nerve  Damage 

2 

27. 

Reti nischis 

2 

28. 

Abnormal  Macula 

1 

29. 

Abnormal  Optic  Nerve  Function 

1 

30. 

Anomalies  (multiple) 

1 

31  . 

Anterior  Clevage  Syndrome 

1 

32. 

Batten’s  Disease 

1 

33. 

Choroi di toi d 

1 

34. 

Coats'  Disease 

1 

35. 

Corneal  Vascularization 

1 

36. 

Gun  Wound 

1 

37. 

Histoplasmosis 

1 

38. 

Hyperopic  Astigmatism 

1 

39. 

Hyperplastic  Primary  Vitreous 

1 

40. 

Microcornea 

1 

41  . 

Myopic  Degeneration 

1 

42. 

No  Diagnosis 

1 

43. 

Photophobi a 

1 

44. 

Prosthesis  (same  as  14) 

45. 

Ptosis 

1 

46. 

Retinal  Degeneration 

1 

47. 

Retinal  Hypoplasia 

Schisis  of  Retina  (see  27) 

1 

48. 

Strabismus 

1 

49. 

Tapeto 

1 

50. 

Toxoplasmosis 

1 

51 . 

Tumor 

1 

52. 

Viral  Encephalitis 

1 

Total  211 


Materials .  The  Diagnostic  Assessment  Procedure  consists  of  40 
items  ranging  from  the  simple  task  of  detecting  a  light  to  the  most 
difficult  items  of  writing  letters  and  reading  simple  words.  The 
40  items  of  the  Diagnostic  Assessment  Procedure  are  broken  down 
into  eight  categories  that  correspond  to  specific  functional  visual 
tasks.  Because  certain  categories  were  more  heterogeneous  thant 
others,  a  different  number  of  questions  were  required  to  adequately 
sample  the  behaviors  in  the  different  categories.  The  eight  cate¬ 
gories  with  the  number  of  items  in  each  category  (shown  in  parenthe¬ 
ses),  along  with  examples  of  test  objectives,  are  as  follows: 
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A.  Awareness  of  visual  stimuli  (2) 

Item  No.  1 •  "Learner  will 
to  light  source." 

B.  Movement  control  of  eyes, 
color  (4) 

Item  No.  3.  "Learner  will 
other. " 

C.  Exploration,  discrimination, 

Item  No.  7.  "Learner  will  see  two 
them. " 

D.  Discrimination  and  identification 
people,  actions  (12) 

Item  No.  14.  "Learner  will  match 
shapes  in  pictures." 

E.  Memory  for  detail,  part  whole  relationships, 
discrimination  (4) 

Item  No.  25.  "Learner  will  identify  object  partially 
den  in  picture." 

F.  Discrimination,  identification,  reproduction 
figures  and  symbols  (4) 


Item  No.  29.  "Learner  will 
si ngle  i nner  detail  . " 

G.  Perception  of  relationships 
symbols  (4) 

Item  No.  33.  "Learner  will 
of  di fferent  si ze. " 

H.  Identification,  perception, 
single  and  combined  symbols 

Item  No.  37.  "Learner  will 
type  styles." 


turn  eyes,  head,  and/or  body 

discrimination  of  shape  and 

look  from  one  light  to  the 

use  of  objects  (6) 

lines  and  move  between 

of  pictures  of  objects, 

solid  color  geometric 

f i gure-ground 

hi  d- 

of  abstract 

match  abstract  figures  by 

in  pictures,  abstract  figures, 

relate  inner  detail  in  figures 

reproduction  of  symbols  of 
(4) 

identify  letters  in  different 


Each  item  specifies  the  visual  task,  the  materials,  the  direc- 
\orll  t  ac^mi m’steri ng  the  item,  and  the  specific  response  required 
o  the  learner  in  order  to  be  considered  correct. 

t  ^  materials  specific  to  administering  an  item  are  self-con- 
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Procedure.  Twelve  teachers  of  the  visually  handicapped  were 
selected  to  be  evaluators.  The  criteria  for  selection  were  as  fol- 
1  ows : 

1.  Interest  in  participating 

2.  Experienced  in  testing  procedures,  specifically  in 
using  the  Visual  Efficiency  Scale  (Barraga,  1970b)  for 
the  assessment  of  low  vision 

3.  Able  to  assess  10  Or  more  students  who  met  the  criteria 
for  participation  in  the  study. 

Each  teacher  was  required  to  attend  a  2  1/2  day  training  session 
held  at  the  American  Printing  House  for  the  Blind  during  the  summer 
of  1978.  During  the  training  sessions  the  rationale  of  the  program 
was  given  along  with  a  demonstration  in  administering  the  entire 
assessment  procedure.  The  teacher-evaluators  then  returned  to  their 
respective  communities  to  assess  their  students.  Each  teacher- 
evaluator  was  asked  to  test  and  retest  each  student  within  a  period 
of  not  less  than  2  nor  more  than  3  weeks  during  the  fall  of  1978. 

The  teacher-eval uators  were  paid  for  their  participation  in  the 
training  session  and  for  each  set  of  test-retest  protocols  returned 
to  the  American  Printing  House  for  the  Blind. 

Results  and  Discussion 


This  instrument  was  examined  for  content  validity  as  well  as 
from  a  psychometric  standpoint.  Both  these  standpoints  are  essen¬ 
tial  to  the  users  of  this  instrument  because  a  person's  performance 
on  the  categories  of  the  test  are  more  important  to  the  examiner 
than  the  total  test  score  (i.e.,  educational  planning  and  educa¬ 
tional  intervention  will  be  based  on  performance  within  the  eight 
categories  rather  than  on  the  test  as  a  whole). 

The  content  validity  of  the  Diagnostic  Assessment  Procedure  is 
quite  good.  In  constructing  the  test  the  developers  reported  review¬ 
ing  over  100  articles  and  books  on  visual  perception,  normal  visual 
development,  visual  impairment,  and  low  vision.  In  addition,  14 
professionals  in  the  areas  of  visual  perception,  low  vision,  and 
teachers  of  the  visually  handicapped  served  as  consultants  on  the 
project.  The  literature  review  and  the  input  from  the  consultants 
provided  the  basis  for  the  development  of  the  eight  functional 
visual  categories  and  the  specific  items  on  the  instrument.  The 
eight  categories  of  the  instrument  appear  to  be  very  comprehensive 
in  covering  the  full  range  of  visual  functioning.  In  addition 
the  items  on  the  instrument  are  representati ve  of  the  visual  abili¬ 
ties  that  would  be  necessary  in  performing  a  wide  range  of  school 
related  visual  tasks. 

The  means,  standard  deviations,  and  standard  errors  of  the 
means  for  the  test-retest  protocols  are  shown  in  Table  3.  The 
average  subject  obtained  a  score  of  approximately  70%  on  both  the 
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test  and  retest  indicating  that  the  Diagnostic  Assessment  Procedure 
was  rather  easy.  A  statistical  test  for  skewness  of  the  distribu¬ 
tion  was  significant  (£  .05).  Visual  inspection  of  the  distri¬ 

bution  showed  a  negative  skewed  curve  with  most  scores  piled  up  at 
the  high  end  of  the  distribution. 

Table  3 

Descriptive  Statistics  for  the  Test  and  Retest  Assessment 

Standard  Standard  error 

Assessment  Mean _ devi ati on _ of  mean 


Test  28.4  (71%)  8.5  .81 

Retest  28.9  (72%)  8.1  .76 


A  comparison  of  the  means  and  standard  deviations  for  both  the 
test  and  retest  demonstrated  a  high  degree  of  consistency  of  visual 
functioning  over  the  period  between  test  and  retest  with  respect 
to  both  average  level  and  degree  of  homogeneity  among  individuals 
in  the  group.  The  small  standard  error  of  the  mean  indicates  that 
there  is  a  probability  of  £  <  .01  that  the  mean  score  for  the  pop¬ 
ulation  is  less  than  two  points  on  either  side  of  the  test  and 
retest  means . 


Item  analysis .  No  negatively  discriminating  items  were  found 
as  a  result  of  either  the  test  or  retest.  However,  there  were  a 
few  items  which  deviated  substantially  in  difficulty  from  other 
items  on  the  test  which  warranted  special  attention.  Table  4  shows 
the  list  of  difficult  items  for  both  the  test  and  retest.  It  should 
be  noted  that  the  same  items  were  found  to  be  difficult  on  both  the 
test  and  retest.  An  analysis  of  these  items  revealed  that  they 
tended  to  demand  drawing  and  graphic  manipulative  skills  which 
predictably  would  be  difficult  for  persons  with  visual  handicaps. 

Table  4 


Difficult  Items 
Test  assessment 
Item  Difficulty  (%) 


in  Test  and  Retest  Assessments 

Retest  assessment 

- - Item _ Difficulty  (%) 


9 

25 

17 

23 

30 

21 

34 

12 

37 

26 

38 

41 

9 

17 

30 

34 

37 

38 


17 

17 

9 

11 

22 

30 
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Reliability  estimates  for  the  Diagnostic  Assessment  Procedure 
were  based  upon  internal  consistency  coefficients  (i.e.,  Kuder- 
Richardsen  20)  and  correlations  between  test  and  retest  results. 

The  reliability  coefficients  and  standard  errors  of  measurement  are 
shown  in  Table  5.  The  internal  consistency  of  both  the  test  and 
retest  were  identical  and  very  high,  £  =  -94.  The  errors  of  measure¬ 
ment  were  extremely  small,  and  it  can  be  concluded  that  an  indivi¬ 
dual's  true  visual  efficiency  score  would  probably  (jd  .68)  be 
found  within  plus  or  minus  two  points  on  either  side  of  his  score 
as  measured  by  this  test.  The  test-retest  correlation  was  £  =  .96 
which  indicates  that  the  Diagnostic  Assessment  Procedure  is  a  highly 
accurate  instrument  and  that  the  type  of  visual  functioning  measured 
by  the  Diagnostic  Assessment  Procedure  does  not  vary  much  from  week 
to  week . 


Table  5 

Reliability  Coefficients  and  Standard  Errors  of 
Measurement  for  the  Test  and  Retest  Assessment 


Test-Retest 


Assessment 

KR  20 

correlation 

Test 

.94 

.96 

Standard  error 

2.1 

1.7 

Retest 

.94 

Standard  error 

1 .9 

1  .6 

Hierarchial  sequence.  It  could  be  hypothesized  that  a  hier¬ 
archical  sequence  from  easy  to  difficult  items  exists  in  the  assess¬ 
ment  procedure.  Such  a  hierarchy  may  exist  in  one  or  both  of  two 
types.  One  type  of  hierarchy  (Type  A)  would  exist  if  the  diffi¬ 
culty  of  the  items  progressed  systematically  from  the  beginning  to 
the  end  of  the  instrument.  This  type  of  hierarchy  would  produce  a 
progressive  decrement  in  the  mean  percentage  scores  for  categories 
A  through  H  which  would  consist  of  clusters  of  items  organized 
sequentially  from  the  beginning  to  the  end  of  the  instrument.  A 
second  type  of  hierarchy  (Type  B)  would  be  based  on  the  assumption 
that  a  state  of  interdependency  exists  among  items  (or  categories). 
Success  at  lower  levels  in  the  structure  would  be  necessary  before 
an  individual  could  respond  adequately  to  items  at  higher  levels 
in  the  hierarchical  structure.  A  Type  A  hierarchy  is  a  necessary 
but  not  a  sufficient  condition  for  a  Type  B  hierarchy. 

Evidence  for  a  Type  A  hierarchy. 

1.  Hierarchy  of  item  difficulty 

Space  precludes  the  description  of  item  difficul¬ 
ties  for  all  40  items,  but  a  visual  inspection  of  item 
difficulty  percentages  in  the  item  analysis  print-out 
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sheet  revealed  a  slight  but  nonsignificant  tendency 
(Kruskal-Wallis  test,  £  >  -05)  for  later  items  to  be 
sliqhtly  more  difficult  than  early  items  in  the 
sequence.  However,  a  number  of  erratic  fluctuations 
in  difficulty  are  in  evidence  from  the  beginning  to 
the  end  of  the  instrument.  Consequently,  this  evidence 
does  not  support  the  notion  of  a  hierarchy  of  item 
di fficul ty . 


2.  Hierarchy  of  category  difficulty 

If  there  is  a  hierarchy  of  category  difficulty  then 
there  should  be  increasing  difficulty  across  categor¬ 
ies.  Table  6  presents  mean  percentage  scores  for  cate¬ 
gories  A-H  for  both  the  initial  test  and  the  retest 
resul ts . 


Table  6 


Mean 

Percentages 

for  Categories  A-H 

on 

the  Initial 

Test  and 

Retest 

Ini tial 

Number 

Ini ti al 

Retest 

test 

Retest 

of 

test  mean 

mean 

Category 

mean 

mean 

i  terns 

percentage 

percentage 

A 

1.87 

1 .91 

2 

94 

96 

B 

3.59 

3.70 

4 

90 

92 

C 

4.64 

4.63 

6 

77 

77 

D 

8.85 

9.25 

12 

74 

77 

E 

2.75 

2.92 

4 

69 

73 

F 

2.69 

2.50 

4 

67 

62 

G 

2.24 

2.33 

4 

56 

58 

H 

1.79 

1.73 

4 

45 

43 

N  =  112 


The  rank  order  of  mean  percentages  for  the  initial  test  range 
is  a  descending  hierarchy  from  a  high  of  94%  for  category  A  to  a  low 
of  45%  for  category  H  and  thus  provides  evidence  for  the  existence 
of  a  Type  A  hierarchy  for  the  category  structure.  The  retest  results 
are  similarly  hierarchical  in  structure  with  the  exception  of  cate¬ 
gory  D.  However,  the  initial  test  provides  better  evidence  for  the 
existence  of  a  hierarchy  because  it  was  not  influenced  by  potential 
practice  effects  that  may  have  occurred  on  the  retest. 


.  — /-1.^ence.  f°r  a  Type  B  hierarchy.  If  a  state  of  dependency 

exists  among  items  (or  categories)  in  a  hierarchial  structure  such 
success  on  tasks  at  a  given  level  in  the  hierarchy  is  dependent 
hpfn  e  mastery  of  other  tasks  at  lower  levels,  then  correlations 

i  ems  at  a  particular  level  and  items  at  successively  higher 
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levels  should  become  progressively  lower.  Similarly,  correlations 
between  items  at  a  given  level  and  other  items  at  successively 
lower  levels  should  become  progressi vely  lower.  Two  different  types 
of  analyses  were  conducted  as  follows: 


1.  Items--Tetrachoric  correlations  were  computed  among  all 
possible  combinations  of  items.  Such  correlations 
describe  the  strength  of  the  relationship  between 
passing  versus  failing  on  one  item  and  passing  versus 
failing  on  another  item.  Space  does  not  permit  a 
listing  of  all  of  these  correlations.  However,  it 

can  be  reported  that  no  trend  existed  among  these 
correlations  in  keeping  with  the  assumptions  of  a 
Type  B  hierarchy  among  items  in  the  test. 

2.  Categories--Tables  7  and  8  provide  evidence  related 
to  the  possibility  of  a  Type  B  hierarchy  among  cate¬ 
gories  A-H. 


Table  7 

Correlations  Among  Categories  A-H 
on  the  Initial  Test 


Cate- 
gori es 

A 

B 

C 

D 

E 

F 

G 

H 


A 

B 

C 

D 

E 

F 

G 

H 

X 

1  .00 

.72 

X 

.67 

.59 

.43 

© 

.44 

.25 

'v 

.72 

1  .00 

.71 

X 

.59 

0 

.60 

.38 

\ 

\ 

.67 

.71 

1  .00 

.72 

X 

.61 

.54 

.40 

^ 

\ 

.59 

(76) 

.72 

1  .00 

.76 

X 

.75 

.72 

7 

.58 

\ 

.43 

/ 

.59 

.61 

.76 

1  .00 

.62 

X 

0 

. — .  / 

03) 

x — /\ 

'  .61 

/ 

0 

C64> 

.62 

1 .00 

.64 

X 

/ 

.52 

_ N, 

\ 

.44 

/ 

;.60) 

.54 

0 

.68 

.64 

1  .00 

.63 

X 

\ 

.25 

.38 

.40 

^•58) 

<©3) 

.52 

.63 

1  .00 

N  =  112 

< - >  Arrows  indicate  direction  of  predicted  trend. 

(  )  Circles  indicate  deviation  from  predicted  trends. 


t 

in  keeping  wth  the  hierarchial  hypothesis.  However,  the  correla- 
an  individual  who  does  not  succeed  at  a  particular  level  cann 


succeed  at  higher  levels  of  visual  functioning 


Table  8 


Percentage  of  Correctly  Predicted  Correlations 
on  the  Initial  Test 


Category 


Percentage 


A 

B 

C 

D 

E 

F 

G 

H 


N  =  112 


86 

71 

86 

86 

71 

57 

57 

71 

Mean  =  73% 


In  summary,  for  individual  items,  no  evidence  exists  to  sup¬ 
port  the  assumption  of  either  type  of  hierarchy.  At  the  level  of 
categories,  however,  it  can  be  concluded  that  a  Type  A  hierarchy 
exists  but  not  a  Type  B  hierarchy.  In  other  words,  significant 
differences  in  difficulty  exist  as  one  proceeds  from  the  early 
category  of  items  to  the  later  categories  in  this  test.  However, 
many  exceptions  exist  to  the  notion  that  later  categories  cannot 
be  responded  to  adequately  by  an  individual  who  does  not  succeed 
at  lower  categori es . 


Construct  validity  of  categories  A-H.  A  factor  analysis  was 
conducted  on  the  initial  test  results.  The  factor  analysis  revealed 
that  one  factor  accounted  for  91%  of  the  variance  and  a  second  fac¬ 
tor  accounted  for  about  5%  of  the  variance.  Three  other  factors 
were  indicated,  but  were  probably  not  valid.  Most  of  the  items 
were  loaded  on  factor  1.  The  second  factor  had  high  factor  load¬ 
ings  on  17  items.  Without  going  into  a  detailed  description  of 
these  results,  it  can  be  said  that  there  was  no  correspondence 
between  the  factor  loading  for  individual  items  and  the  hypothesized 
categories  A-H.  If  these  categories  had  construct  validity,  then 
items  for  a  given  category  would  load  highly  on  that  category  but 
would  show  low  loadings  on  other  categories.  Such  results  were  not 
found. 
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Visual  inspection  of  i nter-correlati ons  among  categories 
revealed  modest  and  significant  correlations  among  all  categories. 

In  fact,  the  correlations  between  test  and  retest  results  for  the 
same  categories  were  not  substantially  larger  than  the  correlations 
among  different  categories. 

It  can  therefore  be  concluded  that  these  categories  lack  con¬ 
struct  validity.  There  is  little  evidence  that  this  instrument 
measures  any  cluster  of  traits  correspondi ng  to  the  hypothesized 
category  system.  From  a  measurement  point  of  view,  even  if  these 
categories  were  valid,  due  to  the  high  correlations  among  all  cate¬ 
gories,  the  error  of  measurement  among  categories  would  be  too 
large  to  permit  any  diagnostic  interpretati on  to  be  placed  upon 
differences  among  category  scores  unless  such  differences  were 
rather  large. 

It  should  be  said,  however,  that  the  requirements  for  factorial 
construct  validity  are  so  rigorous  that  few,  if  any,  psychological 
or  educational  measuring  instruments  meet  such  criteria  today. 

Most  published  reading  tests,  for  example,  report  substantial  inter- 
correlated  subtest  scores  to  be  used  for  diagnostic  purposes.  Factor 
analysis  of  such  tests  seldom  reveal  factors  correspondi ng  to  most 
subtest  titles.  Yet,  these  tests  are  obviously  useful  diagnostic 
tools.  They  may  display  adequate  content  validity  and  criterion 
related  validity  despite  the  lack  of  factorial  validity. 

Paradoxical ly ,  despite  the  previously  discussed  results  con¬ 
cerning  the  lack  of  construct  validity  of  this  instrument,  it  would 
nevertheless  be  feasible  to  use  this  category  system  as  an  organiza¬ 
tional  tool  for  relating  assessment  results  to  treatment  procedures. 
The  rationale  for  this  decision  would  rest  upon  both  the  substantial 
content  validity  of  this  instrument  and  an  expected  Type  A  hierarchy 
among  categories.  The  content  of  this  instrument  was  based  upon  a 
rational  analysis  by  professionals  in  the  field  of  the  visually 
handicapped  as  well  as  psychologists  who  were  knowledgeable  in  the 
field  of  visual  perception. 

If  the  category  structure  were  to  be  used  as  a  diagnostic  tool 
justified  on  pragmatic  if  not  entirely  on  rigorous  psychometric 
grounds,  it  would  be  necessary  that  these  categories  possess  a 
reasonably  high  degree  of  reliability  and  a  low  degree  of  measure¬ 
ment  error.  Results  in  Tables  6  and  9  provide  evidence  for  this 
decision. 
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Table  9 


Reliability  Coefficients  and  Standard  Error  of 
Measurement  for  Categories  A-H 


Category  _ Rel  i  abi  1  i  ty* * 


Standard  error 
SD**  _ of  measurement** 


A 

B 

C 

D 

E 

F 

G 

H 


.83 

.41 

.84 

.91 

.80 

1 .31 

.89 

2.84 

.86 

1.26 

.76 

.97 

.69 

1.13 

.83 

1  .44 

.17 

.36 

.59 

.94 

.62 

.47 

.63 

.59 


N  =  112 

*  Correlations  between  pre  and  post  assessment. 

**  Based  on  pre-assessment  results. 


It  can  be  seen  that  the  reliability  coefficients  in  Table  9 
are  surprisingly  high  (considering  the  small  number  of  items  in 
each  category)  and  the  errors  of  measurement  are  very  low.  Also, 
the  similarity  between  test  and  retest  means  in  Table  6  indicates 
a  remarkable  stability  in  test  performance  within  each  category. 

It  should  be  noted,  however,  that  the  reliability  coefficients  (see 
Table  9)  for  categories  F  and  G  are  lower  than  the  coefficients  for 
the  other  categories.  Careful  study  should  be  given  to  the  items 
in  these  two  categories.  Results  for  categories  F  and  G  shown  in 
Tables  7  and  9  also  suggest  that  some  unidentified  problem  exists 
among  the  items  in  these  categories.  That  is  to  say,  the  predicted 
correlation  trends  in  these  tables  for  categories  F  and  G  are  less 
precise  than  for  other  categories. 


One  of  the  limitations  of  the  preceding  analysis  concerns  the 
nature  of  the  population  sample.  The  results  were  limited  to  those 
individuals  who  were  selected  on  the  basis  of  visual  acuity  of  20/200 
or  less  with  no  additional  handicaps  (mental  or  physical)  that  might 
interfere  with  their  performance  on  the  test.  Furthermore,  since 
the  population  of  visually  handicapped  persons  is  quite  heterogeneous 
with  respect  to  the  nature  of  the  eye  disorder  as  well  as  visual 
acuny  and  visual  field,  it  is  an  open  question  as  to  the  nature  of 
the  relationship  between  these  visual  characteristics  and  perfor- 

JS!nCaK,y’  ^his  is  a  diff,cult  problem  to  investigate  due 
to  the  small  number  of  persons  that  would  fall  into  any  category. 

arr„rI?/?nClUS10n;  Te  ?1a?nostic  Assessment  Procedure  is  a  highly 
val?di^  Ch  als°  displays  a  high  level  of  content 

correlation  nf  pi^rPose-  M°re  evidence  is  needed  concerning  the 
correlation  of  performance  of  this  instrument  with  related  variables 
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to  determine  its  criterion  related  validity.  Within  the  context  of 
this  program  the  Diagnostic  Assessment  Procedure  instrument  seems 
to  be  well  designed  for  identifying  effective  training  procedures 
for  use  with  individuals. 

Field  Evaluation  of  the  Program  to  Develop 

Efficiency  in  Visual  Functioning 

The  purpose  of  the  final  stage  of  the  project  was  to  evaluate 
the  program  under  actual  conditions  of  use  by  teachers  of  visually 
handicapped  students  in  both  residential  and  public  school  programs 
to  determine: 

1.  the  extent  to  which  teachers  could  use  the  program  without 
training  or  additional  aid 

2.  if  there  were  any  materials  or  procedures  that  needed  to 
be  modified  before  the  program  was  finalized  for  produc¬ 
tion 

3.  how  the  program  was  used  by  the  teachers  and  how  effective 
i t  was . 

Method 


Subjects .  The  subjects  for  this  evaluation  were  11  teachers 
of  legally  blind  students  who  were  able  to  work  with  one  to  three 
visually  handicapped  students.  The  criteria  for  teacher  selection 
were : 

1.  interest  in  participating 

2.  familiarity  with  the  Utilization  of  Low  Vision  Kit 

3.  access  to  one  to  three  legally  blind  students  during 
the  early  part  of  the  1979-80  school  year 

4.  time  to  schedule  a  minimum  of  30  minutes  per  day,  3 
days  per  week,  for  a  period  of  8  weeks  with  each  stu¬ 
dent. 

The  teachers  were  selected  to  represent  a  wide  geographical 
area  as  well  as  public  and  residential  schools.  There  were  six 
teachers  from  residential  schools  and  five  from  public  schools. 

The  11  teachers  were  from  the  following  states:  Arkansas,  Louisiana, 
Nebraska,  New  Jersey,  New  Mexico,  North  Carolina,  Minnesota,  Ohio, 
Virginia,  and  Wisconsin. 

The  students  assessed  by  each  teacher  were  selected  by  Ameri¬ 
can  Printing  House  for  the  Blind  project  staff  from  lists  of  poten¬ 
tial  students  enrolled  in  a  particular  teacher's  program  or  school. 
The  criteria  for  selection  were: 
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1  legally  blind— light  perception  to  20/200  and/or  a 
visual  field  of  20  degrees  or  less 

2.  a  minimum  of  1  year  of  educational  experience 

3.  willingness  of  student  and,  where  appropriate,  parent 
or  guardian  to  participate. 

Using  these  criteria,  22  students  (11  males  and  11  females) 
were  selected  to  participate  in  the  field  evaluation.  The  students 
ranged  in  age  from  5.6  years  to  18.5  years  with  an  average  age  of 
10.7  years.  The  eye  conditions  listed  by  incidence  as  represented 
in  the  sample  are  shown  in  Table  10.  The  reader  should  note  that 
the  total  number  (39)  of  eye  disorders/diseases  exceeds  the  total 
number  of  subjects  (22)  in  the  sample  because  several  subjects  had 
more  than  one  disorder/disease.  Eight  subjects  (36.4%)  were  from 
public  schools  and  14  subjects  (63.6%)  were  from  residential  schools. 
The  number  of  subjects  in  each  of  the  nine  visual  categories  as 
suggested  by  the  National  Society  for  the  Prevention  of  Blindness 
is  shown  i n  Table  1 1 . 


Table  10 

Diagnoses  and/or  Causes  of  the  Eye  Disorders 
Represented  in  the  Testing  Sample  (Arranged  by  Incidence) 


Eye  conditions 

(or  cause  of  blindness)  Inci dence 


Nystagmus  7 
Cataracts  6 
Glaucoma  3 
Optic  atrophy  3 
Optic  nerve  damage  3 
Albinism  2 
Esotropia  2 
Retinal  detachment  2 
Aphakia  1 
Coloboma  1 
Corneal  scarring  1 
Head  injury  1 
Hemianopsia  i 


Hyperopic  astigmatism 

Keratoconus 

Myopi a 

Retrolental  fibroplasia 
Rubel la 
Toxoplasmosis 
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Table  11 


The  Number  of  Subjects  in  the  Testing  Sample  for  Each 
of  the  Visual  Categories  as  Suggested  by  the 
National  Society  for  the  Prevention  of  Blindness 


Visual  Categories 

Number  of  subjects 

I 

20/200  -  18/200 

4 

II 

17/200  -  13/200 

3 

III 

12/200  -  08/200 

9 

IV 

07/200  -  03/200 

0 

V 

2.5/200-  .4/200 

0 

VI 

Counts  fingers 

1 

VII 

Hand  movements  (includes  "forms"  and 
object  perception) 

1 

VIII 

Light  projection  and/or  perception 
(includes  shadows) 

1 

IX 

Total ly  b 1 i nd 

0 

Not  reported 

3 

Materials .  Each  teacher  was  sent  a  full  set  of  materials  con- 
training  all  four  components  of  the  program.  These  included: 

Section  I  Theme  and  Organization  of  Complete  Program 
Section  II  Diagnostic  Assessment  Procedure 
Section  III  Design  for  Instruction 
Section  IV  Source  Book  on  Low  Vision 

Additionally,  each  teacher  was  sent  an  appropriate  number  of  low 
vision  observation  checklists  and  record  booklets  and  two  question¬ 
naires  designed  to  evaluate  the  use  of  the  program  by  critiquing 
each  component  of  it. 

One  questionnaire  was  an  individual  lesson  evaluation  form 
which  consisted  of  10  yes/no  questions  with  space  provided  for 
reasons/suggestions  beside  each  question.  The  aim  of  the  question¬ 
naire  was  to  determine  whether  a  specific  lesson  used  by  a  teacher 
was  clear,  useful,  and  accomplished  the  teaching  objective.  A  copy 
of  this  questionnaire  is  provided  in  Appendix  B. 

Another  questionnaire  was  designed  to  evaluate  the  entire 
Program  to  Develop  Efficiency  in  Visual  Functioning.  The  question¬ 
naire  consisted  of  59  yes/no  questions  with  space  provided  for 
reasons/suggestions  beside  each  question.  The  questionnaire  was 
divided  into  separate  components  and  subcomponents  so  that  each  of 
them  could  be  evaluated  individually.  The  components  and  subcom¬ 
ponents  of  the  program  evaluated  by  this  questionnaire  were  as 
fol lows : 

1 .  Purpose 

2.  Use  of  each  program  component 
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3.  Program  guide 

4.  Diagnostic  Assessment  Procedure 

a.  Preface 

b.  Evaluator's  guide 

c.  Assessment  items 

d.  Assessment  materials 

e.  Instructional  planning  index 

f.  Record  booklet 

g.  Demographic  sheet 

h.  Criteria  for  mastery 

i.  Summary  table 

5.  Design  for  Instruction 

a.  Guide 

b.  Lessons 


6.  Supplemental  Source  Book 

a.  Glossary 

b.  Materials  source  list 


7.  Low  Vision  Observation  Checklist 


8.  Packaging 

9.  Magnifiers 


10.  Placement  of  separate  components 

11.  Program  for  effectiveness 

A  copy  of  the  questionnaire  is  provided  in  Appendix  C.  Instruc¬ 
tions  which  accompanied  the  materials  also  requested  the  teachers 
to  make  margin  notes  at  any  place  in  the  materials  where  clarifica¬ 
tion  or  modification  was  needed. 


PrinfT"nnCHnUre'*-F  Th®,  te^hers  selected  were  contacted  I 

criteria  P^hif°h  Hhe  ^  project  Personnel  accord! 
criteria  established  and  detailed  in  the  Subject  sectii 


American 
to  the 
Teachers 
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were  asked  to  submit  a  list  of  their  students  along  with  identifying 
data  such  as  age,  sex,  grade  level,  visual  acuity,  field  of  vision, 
and  eye  condition.  From  this  list,  a  maximum  of  three  students  and 
one  alternate  were  selected  with  whom  each  teacher  would  work.  Each 
teacher  was  asked  to  fill  out  the  Low  Vision  Observation  Checklist 
and  administer  the  Diagnostic  Assessment  Procedure  to  each  student. 

On  the  basis  of  the  assessment,  each  teacher  selected  the  appropri¬ 
ate  lessons  to  use  with  each  student--as  identified  in  the  program-- 
in  a  course  of  instruction  to  improve  the  utilization  of  low  vision. 
Each  teacher  worked  with  each  student  for  a  maximum  of  30  minutes 
per  day,  3  days  per  week,  for  8  consecutive  weeks.  At  the  comple¬ 
tion  of  the  training  period,  each  teacher  administered  the  Diagnostic 
Assessment  Procedure  again  to  determine  the  nature  and  extent  of 
the  change  from  pre-  to  postassessment.  Each  teacher  completed  the 
questionnaire  after  using  the  program  and  returned  all  materials  to 
the  American  Printing  House  for  the  Blind. 

Results  and  Discussion 


The  data  consisted  of  information  from  the  questionnaires  as 
to  the  usefulness  of  various  components  of  the  program,  along  with 
suggestions  for  improvement;  margin  notes  critiquing  the  program; 
and  pre-  and  postassessment  data.  The  field  evaluation  question¬ 
naire  is  presented  in  Appendix  C  and  shows  how  the  teachers  responded 
to  each  of  the  59  questions  along  with  their  comments.  Wherever  the 
consensus  of  the  teachers  indicated  that  some  part  of  the  program 
needed  revision  or  clarification,  their  specific  comments  enabled 
American  Printing  House  for  the  Blind  personnel  to  pinpoint  the 
source  of  the  difficulty  so  that  appropriate  changes  could  be  made. 

A  summary  of  the  responses  to  each  of  the  components  of  the  program 
is  as  follows: 

1.  Purpose--The  purpose  and  use  of  the  program  was  clear  to 
82%  of  the  teachers.  Of  the  teachers  who  reported  having 
a  problem,  only  one  teacher  provided  a  written  comment 
that  stated  that  the  program  was  "clear  but  the  amount  of 
reading  was  overwhelming."  Consequently,  no  changes  were 
made  in  the  purpose. 

2.  Use  of  each  program  component--Al 1  the  teachers  stated  that 
they  would  read  completely  or  read  parts  of  and  skim  the 
rest  of  the  Program  Guide,  Diagnostic  Assessment  Procedure, 
and  the  Design  for  Instruction.  For  the  Supplemental  Source 
Book,  82%  said  they  would  only  skim  it.  However,  none  of 
the  teachers  found  any  of  the  components  unnecessary. 

3.  Program  Gui de — A1 1  the  teachers  found  the  Program  Guide  to 
be  clearly  written  with  adequate  content  and  appropriate 

i nformati on. 

4.  Diagnostic  Assessment  Procedure--Al 1  the  teachers  found  the 
Evaluator's  Guide  clear,  appropriate,  and  consistent  with 
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respect  to  the  rationale  and  information  presented.  How¬ 
ever,  there  were  specific  problems  with  some  of  the  assess¬ 
ment  materials,  namely: 

a.  Penlights— These  were  found  to  be  functioning  improperly 
and  consequently  were  replaced  with  different  penlights 
that  had  been  field  tested  previously. 

b.  Work  Mats--The  work  mats  tore  easily  and/or  did  not 
unfold  easily.  Consequently,  these  were  replaced  with 
felt  work  mats  that  eliminated  both  problems  found  in 
the  field  evaluation. 

c.  Six  Million  Dollar  Man  Doll— A  number  of  problems  were 
indicated  with  the  doll  and,  consequently,  a  different 
doll  was  substituted  in  the  kit. 

d.  Cards  and  Shapes--The  problems  specified  have  primarily 
concerned  difficulties  related  to  manipulating  and 
sorting  the  cards.  Consequently,  the  packaging  of 
these  materials  was  changed  to  facilitate  sorting  and 
ease  of  manipulation. 

5.  Design  for  Instruction--91%  of  the  teachers  found  the  Design 
for  Instruction  clearly  written,  useful,  and  lessons  properly 
sequenced. 


6.  Supplemental  Source  Book--91%  of  the  teachers  found  the 
Sourcebook  to  be  appropriate  in  content,  clearly  written, 
and  useful.  However,  70%  of  the  teachers  did  not  use  any 
items  that  were  listed  in  the  Materials  Source  List  in 
working  with  their  students.  The  primary  reason  given  was 
lack  of  time  during  the  school  day. 

7.  Low  Vision  Observation  Checl ist— 90%  of  the  teachers  found 
the  Checklist  to  be  appropriate  in  format  and  content. 


Packagi ng  A1 though  91%  of  the  teachers  found  the  packaging 
adequate,  40%  had  specific  suggestions  for  improving  it. 
These  suggestions  focused  on  making  a  lighter  weight  con¬ 
tainer  with  better  handles.  Consequently,  the  packaging 
was  redesigned  to  conform  to  these  suggestions. 

Magni fiers--These  were  included  in  the  program  so  that 
teachers  who  had  students  that  could  benefit  from  using 
magnifiers  would  have  them  readily  available.  There  were 
sHHrocc ^  f ss s merit  items  or  lessons  in  the  program  that 
that  ->-_  e  use  ma9oifiers.  However,  it  was  apparent 
to  accpc-c  P  Pe^cen^a9e  of  the  teachers  did  not  know  how 
niaanif?pr<  S^dent  s  needs  with  respect  to  the  use  of 
Book  on TL  v?cnCe  ma3n!fication  is  discussed  in  the  Source 
ment  and  ucp  nf10n  and  detailed  instructions  on  the  assess- 
J  magnifiers  by  low  vision  students  was  beyond 
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the  scope  of  this  program,  no  additional  instructional 
materials  were  added  to  the  program.  However,  the  decision 
was  made  to  include  three  magnifiers  in  the  program  for 
those  teachers  and/or  learners  who  know  how  to  use  them. 

10.  Placement  of  Separate  Components--80%  of  the  teachers 
stated  that  the  Program  Guide  should  be  kept  as  a  separate 
volume.  However,  it  was  found  that  after  the  Program  Guide 
was  edited  in  final  form,  the  number  of  pages  were  so  few 
that  it  became  apparent  that  it  was  uneconomical  and 
impractical  to  keep  it  as  a  separate  volume.  Consequently, 
the  Program  Guide  and  Diagnostic  Assessment  Procedure  were 
combined  into  a  single  volume. 

11.  Program  Effecti veness--All  the  teachers  found  the  program 
to  be  effective  with  91%  rating  it  as  excellent  and  9% 
found  it  very  useful  but  limited  in  scope.  Unsolicited 
comments  from  the  teachers  indicated  that  the  program  was 
precisely  what  they  needed  in  order  to  identify  students' 
visual  abilities  and  functional  limitations  and  to  improve 
visual  functioning  using  prepared  lessons  in  a  sequential 
procedure.  Additional  data  on  the  use  and  effectiveness 
of  the  program  are  evident  from  the  performance  of  the 
students  in  the  Diagnostic  Assessment  Procedure  which  was 
given  as  a  pretest  before  instruction  and  as  a  posttest 
after  instruction.  The  means,  ranges,  and  standard  devia¬ 
tions  of  the  assessment  time  on  the  pre-  and  postassess¬ 
ment,  the  number  of  days  between  the  pre-  and  postassess¬ 
ment,  and  the  pre-  and  postassessment  scores  are  shown  in 
Table  12.  The  amount  of  time  necessary  for  administering 
the  Diagnostic  Assessment  Procedure  decreased  substantially 
from  the  pre-  and  postassessment  administration.  The 
preassessment  required  132.27  minutes  to  administer,  while 
the  postassessment  required  95.24  minutes  to  administer. 

The  mean  number  of  days  between  the  pre-  and  postassess¬ 
ment  was  62.81  days.  On  the  preassessment  the  students' 
mean  performance  was  27.27  items,  and  on  the  postassess¬ 
ment  it  was  31.68  items.  The  difference  between  the  pre- 
and  postassessment  scores  was  significant  ( t_  =  6.43, 

df  =  21 ,  jd  <  .001).  Of  the  22  students  in  the  study,  20 
students  showed  a  gain  from  pre-  to  postassessment,  one 
showed  no  change,  and  one  student  showed  a  decline  of  just 
one  item  from  pre-  to  posttest.  The  range  of  changes  from 
pre-  to  postassessment  test  extended  from  1  to  11  items. 

In  the  previous  study  the  mean  number  of  items  correct  on 
the  preassessment  was  28.4  which  compares  favorably  to  the 
mean  of  27.27  on  the  preassessment  of  the  present  study. 

On  the  postassessment  of  the  previous  study  the  mean  was 
28.9  items.  Since  there  was  no  significant  change  from 
the  pre-  to  postassessment  in  the  previous  study  in  which 
no  instruction  was  given  between  the  pre-  and  postassess¬ 
ment,  this  outcome  suggests  that  the  instructional  program 
was  effective  in  increasing  the  visual  efficiency  of  low 
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vision  students.  Of  more  specific  interest  are  the  changes 
from  pre-  to  postassessment  as  a  function  of  the  category 
structure.  Table  13  shows  the  score  and  percentages  on 
pre-  and  postassessments,  the  mean  percentage  change  from 
pre-  to  postassessment,  and  the  number  of  students  who 
showed  a  positive,  negative,  or  no  change  from  pre-  to 
postassessment.  There  were  little  or  no  changes  from  pre- 
to  postassessment  on  the  items  in  the  first  two  categories 
(A  and  B)  of  the  Diagnostic  Assessment  Procedure.  This 
was  due  to  the  fact  that  almost  all  the  students  got  these 
items  correct  on  the  preassessment  and  these  represent  the 
lowest  level  of  visual  functioning  on  the  instrument.  The 
largest  changes  occurred  in  Category  E  which  involves  items 
related  to  figure  ground  discrimination,  part-whole  rela¬ 
tionships,  and  memory  for  detail,  where  the  students 
showed  a  20.50%  increase  from  pre-  to  postassessment.  It 
should  be  noted  that  on  the  postassessment,  the  data  indi¬ 
cated  a  sequential  difficulty  from  Category  A  to  Category 
H  after  instruction,  and  that  50%  of  the  students  were 
unable  to  complete  these  items.  These  data  suggest  that 
the  instructional  program  could  be  used  over  a  longer 
period  than  the  approximately  8  weeks  used  in  the  present 
study  in  order  to  increase  the  use  of  low  vision  beyond 
that  found  here. 


Table  12 

Summary  of  Statistics  on  the  Pre-  and  Postassessment 


Standard 

Mean  Range  _ deviation 


Number  of  days  between 
pre-  and  postassessment 

62.81 

36-98 

uKvmuun 

14.87 

Administration  time  on 
preassessment  (in  min.) 

132.27 

60-270 

57.89 

Administration  time  on 
postassessment  (in  min.) 

95.24 

45-180 

37.94 

Preassessment  scores 
(number  of  correct  items) 

27.27 

4-38 

9.76 

Postassessment  scores 
(number  of  scorrect  items) 

31 .68 

4-40 

10.43 
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After  administering  the  preassessment  all  the  teachers  were 
able  to  select  the  appropriate  lessons  to  be  used  as  part  of  an 
instructional  program.  As  a  group,  141  of  the  150  lessons  were 
used  by  one  or  more  of  the  teachers.  The  lessons  used  and  the 
number  of  times  each  lesson  was  used  is  shown  in  Appendix  D. 

Each  teacher  made  margin  notes  on  each  of  the  lessons  they  used 
indicating  changes  they  wanted  made.  In  addition  each  teacher 
completed  an  individual  lesson  evaluation  form  for  each  lesson 
actually  used  with  a  student.  The  margin  notes  on  all  the  written 
materials  were  compiled,  summarized,  and  reviewed  by  American 
Printing  House  for  the  Blind  personnel  and  appropriate  changes 
were  made  in  the  written  material.  All  written  material  was  then 
given  to  a  professional  editor  for  final  editing  before  being 
turned  over  to  production. 


In  summary,  the  field  evaluation  showed  that  the  program 
could  be  used  by  teachers  of  the  visually  handicapped,  without 
additional  training,  to  facilitate  the  use  of  residual  vision  in 
low  vision  students.  A  number  of  problems  with  the  materials  were 
identified  and  corrected  after  which  all  written  material  was 
professionally  edited  for  publication. 


The  final  version  of  these  materials  is  called  the  Program  to 
Develop  Efficiency  in  Visual  Functioning.  The  program  components 
are  contained  in  two  packages  which  also  serve  as  carrying  cases 
Package  1-DIAGNOSTIC  ASSESSMENT  PROCEDURE— contains  materials 
needed  for  assessment.  These  materials  should  be  used  for  no 
other  purpose.  They  include  Volume  1,  Diagnostic  Assessment  Pro¬ 
cedure;  10  copies  of  the  Low  Vision  Observation  Checklist;  10 
copies  of  the  Diagnostic  Assessment  Procedure  Record  Booklet;  and 
graphics  and  other  materials  used  for  assessment.  Package  2— 
DESIGN  FOR  INSTRUCTION— i ncl udes  Volume  2,  Design  for  Instruction; 
a  Source  Book  on  Low  Vision;  an  Instructional  Planning  Index;  150 
sequenced  lessons  in  eight  categories  on  color-coded  cards- 
graphics  for  use  with  the  lessons;  and  three  optical  aids.’  Lists 

instructional ^progra^are  ^  ^  Wl ' ^  the 

the  the  American  Anting  House  for 
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Project  Consultants 


Mrs.  Marianne  May  Apple 
Editor,  Low  Vision  Abstracts 
34  Wellesley  Road 
Upper  Montclair,  N.  J.  07043 

Dr.  Edward  P.  Berla' 

Coordi nator 

Vision  Impairment  Program 
Department  of  Special  Education 
School  of  Education 
University  of  Louisville 
Louisville,  Kentucky  40208 

Mrs.  Joyce  Bromley 
Sight  Conservationist 
Materials  Center  for  Visually 
Handi capped 
Knoxville  City  Schools 
925  Oglewood  Avenue,  Room  24 
Knoxville,  Tennessee  37917 

Mrs.  Pat  Carpenter 
Education  Consultant 
Visually  Impaired  Program 
KeKalb  County  School  System 
Department  of  Special  Education 
The  Robert  Shaw  Center 
385  Glendale  Road 
Scottdale,  Georgia  30079 

Mrs.  Ruth  Holmes 
Educator  and  Consultant 
Illinois  School  for  the  Visually 
Handi capped 
658  East  State  Street 
Jacksonville,  Illinois  62650 

Mrs.  Wilma  A.  Hull 
163  Grove  Street 
Lexington,  Mass.  02173 

Dr.  Randy  Jose 
Center  for  the  Blind 
36th  Street  and  Lancaster  Avenue 
Philadelphia,  Pennsylvania  19104 


Dr.  Rosemary  O'Brien 
Supervisor  Vision  Services 
Vision  Services  Center 
Montgomery  County  Public  Schools 
5010  Moorland  Lane 
Bethesda ,  Maryland  20014 

Dr.  Douglas  K.  Ozias 
Deputy  Director 

Governor's  Coordinating  Office  for 
the  Visually  Handicapped 
Stokes  Building 
Suite  105 

Austin,  Texas  78701 

Dr.  Earl  F.  Rankin 
Professor  of  Education 
Department  of  Curriculum  and 
Instruction 
College  of  Education 
University  of  Kentucky 
Lexington,  Kentucky  40506 

Dr.  Rona  Wi 1  Ten  Shaw 
Institute  of  Child  Study 
Kean  College  of  New  Jersey 
Morris  Avenue 
Union,  New  Jersey  07083 

Mrs .  Rose  Skol nick 
Head,  Vision  Stimulation  Program 
Overbrook  School  for  the  Blind 
64th  Street  and  Malvern  Avenue 
Philadelphia,  Pennsylvania  19151 

Miss  Mildred  Smith 
Teacher 

Texas  School  for  the  Blind 
1 100  West  45th  Street 
Austin,  Texas  78756 

Dr.  Dean  W.  Tuttle 

Associate  Professor,  Area  Coordinator 
University  of  Northern  Colorado 
Greeley,  Colorado  80631 
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Lesson  No. 


Individual  Lesson  Evaluation  Form 
Student _ Teacher 


1.  Did  the  lesson  address  its 

objecti ve? 

L  1  UMb 

2.  Was  the  procedure  clear? 

3.  Were  you  able  to  use  this 

lesson  in  working  with  the 
student? 

4.  Were  the  tangible  materials 

necessary  for  teaching  the 
lesson  easily  acquired? 

5.  Were  the  materials  listed 

on  the  lesson  plan  suffi¬ 
cient  to  teach  this  lesson? 

6.  If  graphics  were  included  in 

this  lesson,  did  you  think 
they  were  clear  and  suffici¬ 
ent  to  teach  what  was 
i ntended? 

7.  Were  the  response  criteria 

specific  enough  so  that  it 
was  clear  whether  the  learner 
performed  correctly  or  incor¬ 
rectly? 

8.  Were  the  procedural  notes 
clear  and  helpful? 

9.  Was  the  section  on  additional 
activities  adequate? 

10.  Overall  did  you  find  this 
lesson  useful? 
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Program  to  Develop  Efficiency  in  Visual  Functioning 
Field  Evaluation  Questionnaire 
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10AJB  Section  I I--Diagnostic  Assessment  Procedure 
8A,3B  Section  III  —  Des i gn  for  Instruction 
9B,2C  Section  I V — Suppl emental  Source  Book 
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SECTION  1 1  —  D I AGNOSTI C  ASSESSMENT  PROCEDURE 
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SECTION  1 1 --DIAGNOSTIC  ASSESSMENT  PROCEDURE 
Assessment  Items 
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SECTION  II--DIAGNOSTIC  ASSESSMENT  PROCEDURE 
Assessment  Materials 
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SECTION  II--DIAGNOSTIC  ASSESSMENT  PROCEDURE 
Assessment  Materials 
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SECTION  1 1 --DIAGNOSTIC  ASSESSMENT  PROCEDURE 
Demographic  Sheet 
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SECTION  1 1 1--DESI GN  FOR  INSTRUCTION 

Section  III  includes  questions  on  the 
Guide  and  the  Lessons.  The  following 
questions  refer  to  each  of  these  parts 
separately . 
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SECTION  III  — DESIGN  FOR  INSTRUCTION 
Lessons 
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SECTION  IV— SUPPLEMENTAL  SOURCE  BOOK 
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SECTION  I V--SUPPLEMENTAL  SOURCE  BOOK 
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Do  you  think  the  proqram  quide  should  be  combined  with  Section  II  (Diagnostic  Assessment  Procedure) 
and  bound  in  one  volume  or  should  they  be  kept  as  separate  and  distinct  volumes? 

Eight  respondents  suggested  keeping  them  separate  and  two  respondents  thought  they  should  be  in  one 
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Appendix  D 

Frequency  of  Lessons  Used 
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Lesson  No. 
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